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Names  of  Under  Graduate  students  supported 


NAME 

PERCENT  SUPPORTED 

Discipline 

Malcolm  Doering 

0.00 

Computer  Science 

Anthony  Curley 

0.00 

Computer  Science 

Joseph  Meleca 

0.00 

Computer  Science 

Hanquing  Hu 

0.00 

Computer  Science 

James  Gung 

0.00 

Computer  Science 

FTE  Equivalent: 

0.00 

Total  Number: 

5 

Student  Metrics 

This  section  only  applies  to  graduating  undergraduates  supported  by  this  agreement  in  this  reporting  period 


The  number  of  undergraduates  funded  by  this  agreement  who  graduated  during  this  period: .  5.00 

The  number  of  undergraduates  funded  by  this  agreement  who  graduated  during  this  period  with  a  degree  in 

science,  mathematics,  engineering,  or  technology  fields: . 5.00 

The  number  of  undergraduates  funded  by  your  agreement  who  graduated  during  this  period  and  will  continue 

to  pursue  a  graduate  or  Ph.D.  degree  in  science,  mathematics,  engineering,  or  technology  fields: . 2.00 

Number  of  graduating  undergraduates  who  achieved  a  3.5  GPA  to  4.0  (4.0  max  scale): . 5.00 

Number  of  graduating  undergraduates  funded  by  a  DoD  funded  Center  of  Excellence  grant  for 

Education,  Research  and  Engineering: . o.OO 

The  number  of  undergraduates  funded  by  your  agreement  who  graduated  during  this  period  and  intend  to  work 

for  the  Department  of  Defense . 0.00 

The  number  of  undergraduates  funded  by  your  agreement  who  graduated  during  this  period  and  will  receive 

scholarships  or  fellowships  for  further  studies  in  science,  mathematics,  engineering  or  technology  fields: . 2.00 

Names  of  Personnel  receiving  masters  degrees 

NAME 
Chad  Byers 

Total  Number:  1 


Names  of  personnel  receiving  PHDs 


NAME 

Andres  Ramirez 

David  Knoester 

Heather  Goldsby 

Brian  Connelly 

Jeff  Clune 

Adam  Jensen 

Chad  Byers 

Benjamin  Beckmann 

Total  Number: 

8 

Names  of  other  research  staff 


NAME 

PERCENT  SUPPORTED 

FTE  Equivalent: 

Total  Number: 

Sub  Contractors  (DD882) 


Inventions  (DD882) 


Scientific  Progress 

The  AWARE  project  has  advanced  the  state-of-the-art  in  several  aspects  of  dynamically  adaptive  systems,  including  the  design 
and  performance  of  adaptive  monitoring  technologies  for  highly  trusted  software  systems.  Many  of  the  proposed  methods 
leverage  evolutionary  computation  to  automatically  generate  new  system  configurations  and  adaptive  logic  to  transition  a 
system  from  one  configuration  to  another  in  a  safe  and  consistent  fashion,  as  well  as  how  to  help  the  system  respond  effectively 
to  adverse  situations.  These  contributions  have  been  well-received  by  the  research  community,  as  AWARE-based  papers  have 
received  several  best  paper  awards  and  nominations  (listed  elsewhere  in  this  report).  The  main  activities  (and  research 
progress)  address  three  key  elements  of  such  systems:  model-driven  engineering  of  adaptive  systems,  assurance  of  adaptive 
systems,  and  decision-making  of  adaptive  systems.  See  attached  discussion  of  each. 

Technology  Transfer 

Throughout  the  course  of  the  AWARE  project,  we  have  collaborated  with  industrial  organizations  in  order  to  obtain  industrial- 
strength  data  to  guide  our  research  and  to  validate  the  research  techniques.  To  ensure  broader  applicability  while  maximizing 
impact,  we  explicitly  sought  applications  from  a  range  of  domains,  all  of  which  involve  the  need  for  high-assurance  in  the  face  of 
uncertain  environmental  conditions. 

Northrop  Grumman  Corporation:  We  collaborated  with  two  groups  of  researchers  and  developers  at  Northrop  Grumman 
Corporation  (NGC).  This  collaboration  was  initiated  when  a  researcher  at  NGC  approached  us  after  reading  about  our  research 
applying  digital  evolution  to  produce  robust,  collective  behavior  in  software  agents.  One  NGC  group  (at  Fort  Wayne,  IN)  applied 
these  technologies  to  problems  in  the  area  of  cyber-security  and  multi-agent  systems.  Subsequent  meetings  between  MSU  and 
NGC  personnel  has  led  to  collaboration  with  a  second  NGC  group  (at  Linthicum,  MD),  interested  in  applying  our  evolutionary 
computation  methods  to  enhance  the  robustness  of  autonomous  systems  such  as  Large  Displacement  Unmanned  Underwater 
Vehicle  (LDUUVs),  These  systems  are  expected  to  survive  without  human  control  for  months  at  a  time. 

Continental  Automotive:  We  collaborated  with  Continental  Automotive  on  applying  evolutionary  computation  to  future  onboard 
automotive  systems.  Continental  provided  descriptions  of  a  steer-by-wire  system  for  an  undergraduate  course,  and  the  students 
created  detailed  requirements  specifications  and  prototypes  for  this  emerging  onboard  system.  The  detailed  specifications 
were  essential  to  exploring  how  the  system  should  adapt  as  it  undergoes  changing  (and  possibly  unexpected)  environmental 
conditions. 

Ford  Motor  Company:  One  of  the  Best  Paper  nominations  involved  our  collaborations  with  Ford  Motor  Company,  where  we 
used  our  techniques  to  analyze  industrial-strength  (but  proprietary-free)  models  provided  by  Ford.  Our  objective  was  to  use  a 
tool  chain,  involving  several  of  our  tools,  including  an  extended  version  of  Marple,  to  look  for  errors  in  the  models.  With  our 
toolchain,  we  were  able  to  look  for  syntactic  and  semantic  errors  that  would  not  be  detectable  using  existing  tools.  Ultimately, 
we  were  looking  for  feature  interactions  with  multiple  automotive  subsystems.  This  tool  chain  can  be  applied  to  other  systems 
that  have  been  modeled  with  state-based  models  and  domain  models.  Ford  also  served  as  customers  for  an  upper-level 
undergraduate  software  engineering  course,  where  they  again  provided  high-level  requirements  for  two  advanced  automotive 
systems  (cooperative,  adaptive  cruise  control  and  onboard  diagnostics  systems). 

BAE  Systems:  We  were  approached  by  researchers  at  BAE  Systems  to  collaborate  on  applying  evolutionary  computation  to  the 
design  and  maintenance  of  software  that  needs  to  adapt  to  changing  requirements  and  new  threats.  In  an  ongoing  project,  we 
are  exploring  how  evolutionary  computation  can  be  used  to  enable  automated  composition  strategies  for  reusing  existing 
software  components. 

HP/Google:  One  of  our  studies,  which  won  a  Best  Paper  Award,  involved  the  use  of  evolutionary  computation  to  enhance 
reliability  of  a  remote  data  mirroring  system  (RDM).  The  case  study  was  provided  to  us  by  an  industrial  collaborator  who  initially 
worked  at  HP  and  then  moved  to  Google,  where  he  continued  to  provide  industrial-strength  data  and  feedback  on  our  research 
results. 


The  AWARE  project  has  advanced  the  state-of-the-art  in  several  aspects  of  dynamically  adaptive  systems,  including  the  design 
and  performance  of  adaptive  monitoring  technologies  for  highly  trusted  software  systems.  Many  of  the  proposed  methods 
leverage  evolutionary  computation  to  automatically  generate  new  system  configurations  and  adaptive  logic  to  transition  a 
system  from  one  configuration  to  another  in  a  safe  and  consistent  fashion,  as  well  as  how  to  help  the  system  respond  effectively 
to  adverse  situations.  These  contributions  have  been  well-received  by  the  research  community,  as  AWARE-based  papers  have 
received  several  best  paper  awards  and  nominations  (listed  elsewhere  in  this  report).  The  main  activities  (and  research 
progress)  address  three  key  elements  of  such  systems:  model-driven  engineering  of  adaptive  systems,  assurance  of  adaptive 
systems,  and  decision-making  of  adaptive  systems.  Each  is  discussed  in  turn. 


1.  MODEL  DRIVEN  ENGINEERING  OF  SELF-MODELING  SOFTWARE 

In  the  early  part  of  the  project,  we  developed  and  extended  a  set  of  design  patterns  intended  to  capture  the  subtleties  found  in 
the  monitoring  portion  of  an  autonomic  computing  system.  These  design  patterns  were  harvested  from  numerous  existing 
frameworks  for  monitoring  in  distributed  applications.  We  extended  the  design  pattern  template  with  additional  fields  specific  to 
adaptation  concerns.  In  addition  to  providing  guidance  for  constructing  design  models  for  implementation,  these  design 
patterns  explicitly  address  the  assurance  concerns  of  the  resulting  models,  using  the  A-LTL  specification  language  (adapt- 
operator  extended  linear  temporal  logic)  previously  developed  by  Zhang  and  Cheng.  We  conducted  a  case  study  in  which  we 
applied  these  adaptation  patterns  to  an  adaptive  news  web  server  intended  to  tolerate  extremely  heavy,  unexpected  loads.  To 
address  assurance  concerns,  we  applied  automated  formal  verification  techniques  (Hydra)  to  ensure  instantiated  pattern 
models  satisfy  invariant  properties  specified  in  each  adaptation  pattern.  By  verifying  the  instantiated  patterns  satisfy  specific 
safety  and  liveness  properties,  we  can  assure  this  system  cannot  reach  an  inconsistent  state  as  a  result  of  a  reconfiguration. 

We  also  investigated  the  use  of  evolutionary  computation  for  automatically  refactoring  object-oriented  (00)  designs  to  improve 
00  metrics  and  introduce  new  design  patterns.  This  technique,  called  REMODEL,  was  applied  to  collection  of  existing  models 
used  as  benchmarks  for  OO-based  refactoring  and  an  existing  web-based  repository  called  REMODD  to  provide  users  with 
model-driven  development  artifacts.  REMODEL  uses  a  genetic  algorithm  (GA)  to  apply  different  combinations  of  mini¬ 
transformations  to  existing  designs.  These  transformations  are  intended  to  be  semantics-preserving.  We  developed  a  number 
of  fitness  criteria  to  drive  the  evolutionary  process  to  identify  viable  refactored  designs.  The  resulting  capability  provides  a 
means  to  automate  the  refactoring  of  designs  to  include  design  patterns  and  improve  the  overall  design  metrics  for  the  system. 
This  work  was  the  first  to  support  this  type  of  design  refactoring. 


2.  ASSURANCE  IN  DYNAMICALLY  ADAPTIVE  SYSTEMS 

Three  key  aspects  of  assurance  were  investigated  as  part  of  the  AWARE  project:  specification  languages,  analysis  support,  and 
model  generation.  The  assurance  investigations  take  advantage  of  A-LTL,  an  adapt-operator  extension  to  Linear  Temporal 
Logic  developed  previously  by  Zhang  and  Cheng  (ICSE  2006,  Distinguished  Paper  Award).  A-LTL  enables  specification  and 
verification  of  invariant  properties  that  must  be  satisfied  before,  during,  and  after  adaptation.  Specifically,  we  model  a 
dynamically  adaptive  program  as  a  collection  of  (non-adaptive)  steady-state  programs  and  a  set  of  adaptations  that  realize 
transitions  among  steady  state  programs  in  response  to  environmental  changes. 

Three  lines  of  investigation  were  pursued  to  support  the  specification  of  adaptive  systems.  First,  we  developed  adaptation 
semantics  in  terms  of  the  A-LTL  specification  language.  As  part  of  this  work,  we  developed  adaptation  patterns  as  well  as 
specification  patterns  that  describe  properties  to  be  satisfied  before,  during,  and  after  adaptation.  These  specification  patterns 
involve  the  use  of  LTL  and  A-LTL  properties  describing  invariant  properties  of  the  non-adaptive  and  the  adaptive  portions  of  a 
system.  Second,  we  developed  the  RELAX  specification  language  to  enable  developers  to  explicitly  identify  sources  of 
uncertainty  when  specifying  the  requirements  of  a  given  system.  This  capability  enables  systems  designers  to  build  in  flexibility 
into  a  system  to  account  for  the  uncertainty,  thus  making  systems  less  brittle.  RELAX  has  been  formalized  in  terms  of  fuzzy 
logic  semantics.  Finally,  we  developed  a  goal-based  modeling  approach  to  modeling  adaptive  systems  that  makes  use  of  the 
RELAXation  of  goals,  which  is  supported  by  our  AutoRELAX  tool  that  harnesses  evolutionary  computation  to  automatically 
generate  RELAXed  goal  models. 

The  second  dimension  of  assurance  is  the  development  and  use  of  a  modular  model  checking  approach  to  verifying  that  a 
formal  model  of  an  adaptive  program  satisfies  its  requirements  specified  in  LTL  and  A-LTL,  respectively.  We  leveraged  the 
extended  version  of  the  assume/guarantee  paradigm  to  develop  three  modular  model  checking  algorithms  that  are  used  to 
verify  global  invariants  and  transitional  properties,  where  local  properties  are  verified  as  part  of  the  transitional  property  model 
checking  algorithm.  Our  approach,  called  AMOebA  (Adaptive  program  Modular  Analyzer),  enables  developers  to  verify  that 
adaptive  programs  adhere  to  requirements  specified  in  LTL  and  ALTL,  including  transitional  properties.  Additionally,  it  reduces 
the  complexity  of  verifying  an  adaptive  program  by  a  factor  of  n,  where  n  is  the  number  of  steady-state  programs.  Moreover, 
additional  or  modified  steady-state  programs  can  be  verified  in  isolation  without  repeating  the  verification  of  the  entire  adaptive 
program.  As  such,  we  apply  the  separation  of  concerns  strategy  both  in  the  modeling  and  in  the  verification  process,  thereby 
simplifying  both  steps. 


Third,  we  applied  evolutionary  computation  to  the  problem  of  generating  models  of  target  systems  that  satisfy  invariant 
properties.  Specifically,  we  developed  Avida-MDE  (based  on  the  Avida  digital  evolution  platform)  to  support  the  automatic 
generation  of  software  models  (i.e.,  state-based  models)  representing  the  target  systems  of  an  adaptive  system.  Avida-MDE 
generates  models  that  satisfy  invariant  requirements  (specified  as  LTL  properties)  user-provided  scenarios,  and  software 
engineering  metrics.  As  an  extension  to  this  work,  we  developed  Avida-Marple,  which  automatically  identifies  latent  properties 
within  models.  These  are  properties  that  were  not  intended  to  be  satisfied  (as  specified  by  requirements).  We  use  Avida-Marple 
to  identify  the  "latent  properties"  satisfied  by  the  target  system  models  to  identify  the  distinguishing  characteristics  thus  enabling 
us  to  match  the  target  systems  to  the  appropriate  set  of  environmental  conditions.  Avida-Marple  can  also  be  used  to  identify 
unwanted  feature  interactions  and  undesirable  latent  properties.  We  later  improved  the  Avida-Marple  work  by  incorporating  a 
technique  called  Novelty  Search,  which  significantly  decreases  the  number  of  properties  identified.  We  applied  Marple  to  find 
unwanted  properties  in  an  automotive  application  obtained  from  one  of  our  industrial  collaborators.  Finally,  we  developed  Loki, 
an  automated  technique  for  identifying  combinations  of  system  and  environmental  conditions  that  cause  requirements 
violations.  Experimental  results  with  an  intelligent  vehicle  application  show  Loki  is  able  to  discover  combinations  of  system  and 
environmental  conditions  that  lead  to  latent  behaviors  and  requirements  violations.  We  also  developed  Plato  to  automatically 
generate  software  configurations  in  response  to  adverse  environmental  changes,  where  the  software  configurations  are  able  to 
balance  competing  tradeoffs  --  the  results  greatly  improve  the  state  of  art  technique  for  generating  run-time  configurations.  This 
work  received  a  Best  Paper  Award  at  the  IEEE  International  Conference  on  Autonomic  Computing  (ICAC).  We  also  developed 
Hermes,  a  technique  for  automatically  generating  the  adaptive  logic  that  moves  the  system  from  one  adaptive  configuration  to 
another  while  ensuring  that  the  system  remains  consistent  as  defined  by  the  A-LTL  specifications. 


3.  DECISION  MAKING  IN  AUTONOMIC  SYSTEMS 

The  third  major  part  of  the  AWARE  project  addresses  run-time  decision  making  in  autonomic  systems,  which  produce  actions  or 
dynamic  reconfigurations  intended  to  improve  performance,  conserve  energy,  or  thwart  an  attack.  A  key  challenge  to  be 
addressed  is  how  such  a  system  deals  with  incomplete  information  and  uncertainty  in  the  environment  as  new  situations  are 
encountered. 

The  AWARE  project  has  produced  several  novel  methods  for  decision  making.  First,  we  developed  Plato,  a  genetic  algorithm- 
based  decision-making  process  that  searches  the  vast  and  complex  space  of  possible  reconfigurations  with  the  objective  of 
identifying  suitable  target  reconfigurations  in  response  to  changing  requirements  and  environmental  conditions.  A  key  benefit  of 
Plato  is  that  developers  need  not  prescribe  reconfiguration  plans  in  advance  to  address  specific  situations  warranting 
reconfiguration.  Instead,  Plato  evolves  suitable  reconfiguration  plans  at  run  time.  Plato-MDE  is  an  extension  of  the  Plato 
system  that  generates  architectural  models  of  target  system  configurations  and  enables  developers  to  indirectly  control  the 
degree  of  change  between  the  current  and  target  system  configurations.  We  later  developed  Hermes,  a  genetic  programming- 
based  decision-making  process  that  accepts  as  input  a  starting  and  target  system  configuration  and  produces  a  series  of 
reconfiguration  steps,  or  an  adaptation  path,  as  output.  A  key  benefit  of  Hermes  is  that  it  is  capable  of  automatically  evolving 
adaptation  paths  that  safely  transition  an  executing  system  from  its  current  configuration  to  its  desired  target  configuration  while 
balancing  tradeoffs  between  functional  and  non-functional  requirements.  Plato-RE  is  another  extension  specifically  intended  for 
adaptive  monitoring  of  software  requirements.  Combined,  these  systems  enable  the  system  to  adapt  in  ways  that  were  perhaps 
unforeseen  or  even  considered  relevant  at  design  time. 

In  the  AWARE  project,  we  have  also  applied  evolutionary  computation  to  realize  robust  and  adaptive  behavior.  Evolutionary 
computation  can  be  leveraged  to  explore  and  apply  a  richer  set  of  behaviors  that  can  withstand  such  adverse  conditions  while 
remaining  mission-effective.  Hence,  these  studies  are  relevant  to  sensor  networks,  autonomous  robots  and  other  cyber¬ 
physical  systems.  Such  systems  need  to  remain  operational  under  highly  adverse  conditions.  In  early  studies,  we  applied 
digital  evolution  and  neuroevolution  (evolution  of  artificial  neural  networks)  to  evolve  energy-efficient  algorithms  for  group 
communication  protocols  such  as  distributed  consensus,  synchronization,  and  quorum  sensing.  Later,  we  applied 
neuroevolution  to  the  design  of  controllers  for  simulated  robots,  evaluating  the  effectiveness  of  different  types  of  encodings.  We 
also  conducted  experiments  on  fundamental  issues  in  the  evolution  of  cooperation,  and  we  have  demonstrated  the  ability  of 
digital  organisms  to  self-organize  and  build  communication  networks  as  well  as  physical  structures  reminiscent  of  bacterial 
biofilms.  Such  behaviors  are  critical  to  the  overall  safety  of  distributed  adaptive  systems,  since  remote  components  are  typically 
monitored  across  unreliable  networks  and  are  at  risk  of  cyber-attack.  Finally,  we  have  explored  the  joint-evolution  of  robot 
control  and  physical  components,  potentially  enabling  artificial  systems  to  approach  the  capabilities  of  animals  in  terms  of 
mobility  and  agility. 


LEVERAGED  FUNDING 

Although  the  budget  for  the  AWARE  project  supported  only  one  graduate  research  assistant,  the  AWARE  project  leveraged 


funding  from  other  resources  in  order  to  accomplish  more  than  could  be  done  with  single  graduate  research  assistant.  Results 
on  evolutionary  computation  from  the  NSF-sponsored  TEAMS  project  (led  by  P.  McKinley)  and  the  Orchid  project  (led  by  B. 
Cheng)  fed  directly  into  techniques  and  algorithms  developed  in  the  AWARE  project.  The  AWARE  project  has  also  made  use 
of  the  Evolution  Park  testbed,  containing  terrestrial  and  aquatic  robots,  a  high-end  3D  printer,  and  extensive  computing  facilities. 
Michigan  State  University  provided  $370K  of  funding  for  research  and  education  in  High-Assurance  Systems  (HAS).  The 
AWARE  project  has  directly  benefited  from  research  and  facilities  supported  by  the  HAS  initiative.  Finally,  the  NSF-sponsored 
BEACON  Center  for  the  Study  of  Evolution  in  Action  provided  fellowships  and  infrastructure  leveraged  in  the  AWARE  project. 

Andres  Ramirez  was  the  primary  graduate  student  supported  on  the  AWARE  project.  However  several  other  students, 
supported  by  the  other  grants  or  working  full-time,  contributed  to  the  project  as  part  of  their  doctoral  research.  These  students 
are:  David  Knoester,  Benjamin  Beckmann,  Heather  Goldsby,  Brian  Connelly,  Erik  Fredericks,  Adam  Jensen,  Chad  Byers,  Jared 
Moore,  Anthony  Clark,  Jeff  Clune).  In  addition,  five  undergraduate  research  assistants  (Malcolm  Doering,  Anthony  Curley, 
Joseph  Meleca,  Hanqing  Hu,  and  James  Gung)  contributed  to  the  AWARE  project  but  were  partially  or  fully  supported  by 
Michigan  State  University. 


CONCLUSIONS 

In  summary,  the  AWARE  project  addressed  the  design  of  adaptive  monitoring  software  and,  more  generally,  high-assurance 
adaptive  systems  that  need  to  deal  with  uncertainty.  Designing  dynamically  adaptive  computing  systems,  especially  those  that 
interact  with  the  physical  world,  is  challenging  because  such  systems  need  to  operate  with  assurance,  yet  somehow 
accommodate  the  uncertainty  of  the  environment.  Our  approach  integrated  rigorous  software  engineering  with  the  open-ended 
search  capabilities  of  evolutionary  computation.  In  particular,  We  incorporated  environmental  uncertainty  explicitly  into  the 
modeling  of  the  behavior  of  the  adaptive  system  and  the  monitoring  infrastructure.  The  resulting  systems  are  resilient  and 
robust  to  changing  environmental  conditions  and  better  able  to  deliver  acceptable  behavior  even  in  the  face  of  adverse 
conditions.  The  innovations  produced  by  the  AWARE  project  have  been  recognized  through  best  papers  awards  at 
conferences.  The  technologies  produced  by  this  project  facilitate  development  of  software  systems  that  exhibit  adaptability  and 
survival  capabilities  analogous  to  those  found  in  natural  organisms.  Collaboration  with  industrial  partners  (described  elsewhere 
in  this  report)  helps  to  ensure  these  methods  will  benefit  real-world  systems. 


Technology  Transfer 

Throughout  the  course  of  the  AWARE  project,  we  have  collaborated  with  industrial  organizations  in  order  to  obtain  industrial- 
strength  data  to  guide  our  research  and  to  validate  the  research  techniques.  To  ensure  broader  applicability  while  maximizing 
impact,  we  explicitly  sought  applications  from  a  range  of  domains,  all  of  which  involve  the  need  for  high-assurance  in  the  face  of 
uncertain  environmental  conditions. 

Northrop  Grumman  Corporation:  We  collaborated  with  two  groups  of  researchers  and  developers  at  Northrop  Grumman 
Corporation  (NGC).  This  collaboration  was  initiated  when  a  researcher  at  NGC  approached  us  after  reading  about  our  research 
applying  digital  evolution  to  produce  robust,  collective  behavior  in  software  agents.  One  NGC  group  (at  Fort  Wayne,  IN)  applied 
these  technologies  to  problems  in  the  area  of  cyber-security  and  multi-agent  systems.  Subsequent  meetings  between  MSU  and 
NGC  personnel  has  led  to  collaboration  with  a  second  NGC  group  (at  Linthicum,  MD),  interested  in  applying  our  evolutionary 
computation  methods  to  enhance  the  robustness  of  autonomous  systems  such  as  Large  Displacement  Unmanned  Underwater 
Vehicle  (LDUUVs),  These  systems  are  expected  to  survive  without  human  control  for  months  at  a  time. 

Continental  Automotive:  We  collaborated  with  Continental  Automotive  on  applying  evolutionary  computation  to  future  onboard 
automotive  systems.  Continental  provided  descriptions  of  a  steer-by-wire  system  for  an  undergraduate  course,  and  the  students 
created  detailed  requirements  specifications  and  prototypes  for  this  emerging  onboard  system.  The  detailed  specifications 
were  essential  to  exploring  how  the  system  should  adapt  as  it  undergoes  changing  (and  possibly  unexpected)  environmental 
conditions. 

Ford  Motor  Company:  One  of  the  Best  Paper  nominations  involved  our  collaborations  with  Ford  Motor  Company,  where  we 
used  our  techniques  to  analyze  industrial-strength  (but  proprietary-free)  models  provided  by  Ford.  Our  objective  was  to  use  a 
tool  chain,  involving  several  of  our  tools,  including  an  extended  version  of  Marple,  to  look  for  errors  in  the  models.  With  our 
toolchain,  we  were  able  to  look  for  syntactic  and  semantic  errors  that  would  not  be  detectable  using  existing  tools.  Ultimately, 
we  were  looking  for  feature  interactions  with  multiple  automotive  subsystems.  This  tool  chain  can  be  applied  to  other  systems 
that  have  been  modeled  with  state-based  models  and  domain  models.  Ford  also  served  as  customers  for  an  upper-level 
undergraduate  software  engineering  course,  where  they  again  provided  high-level  requirements  for  two  advanced  automotive 
systems  (cooperative,  adaptive  cruise  control  and  onboard  diagnostics  systems). 

BAE  Systems:  We  were  approached  by  researchers  at  BAE  Systems  to  collaborate  on  applying  evolutionary  computation  to  the 
design  and  maintenance  of  software  that  needs  to  adapt  to  changing  requirements  and  new  threats.  In  an  ongoing  project,  we 
are  exploring  how  evolutionary  computation  can  be  used  to  enable  automated  composition  strategies  for  reusing  existing 
software  components. 

HP/Google:  One  of  our  studies,  which  won  a  Best  Paper  Award,  involved  the  use  of  evolutionary  computation  to  enhance 
reliability  of  a  remote  data  mirroring  system  (RDM).  The  case  study  was  provided  to  us  by  an  industrial  collaborator  who  initially 
worked  at  HP  and  then  moved  to  Google,  where  he  continued  to  provide  industrial-strength  data  and  feedback  on  our  research 
results. 


